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(54) Digital signal multiplexing, transmission and recording method and apparatus and 
recording medium 



(57) A digital signal multiplexing method and appa- 
ratus in which plural degree-one multiplexed streams 
produced on time-divisionally multiplexing a bitstream 
of one or more digital signals are received and are time- 
divisionally multiplexed to generate a degree two multi- 
plexed stream. Specifically, plural degree-one multi- 
plexed streams are received, and the received degree- 
one multiplexed streams are time-divisionally multi- 
plexed based on a repetitive' pattern associated with the 
bitrate of the respective degree-one multiplexed 



streams to generate a degree two multiplexed stream. 
The time reference value attached to the degree two 
multiplexed stream is corrected based on the reference 
clocks not synchronized with the system clocks of the 
degree-one multiplexed streams. A pre-set volume of 
the dummy data is multiplexed if the corrected time ref- 
erence value becomes larger than the time reference 
value attached to the degree-one multiplexed streams. 
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Description 

[0001] This invention relates to a signal multiplexing method and apparatus for multiplexing digital signals, such as for 
example picture or speech signals, to generate degree-one multiplexed streams, such as for example television-pro- 
5 gram-based streams, degree-two multiplexing these plural degree-one multiplexed streams to generate a degree-two 
multiplexed stream to transmit or record the generated degree-two multiplexed stream, a digital signal transmission 
method and apparatus, a digital signal recording method and apparatus, and to a recording medium having the multi- 
plexed data recorded thereon. 

[0002] In ISO 13818-1, there is prescribed a transport stream for multiplexing plural programs, such as television 
w broadcast programs, into a sole multiplexed stream, and transmitting the multiplexed stream. Up to now, there is known 
a multiplexing system for generating this transport stream. 

[0003] Fig.l shows a structure of a broadcast system transmitting this transport stream using, for example, a digital 
broadcasting satellite. 

[0004] To a transmitting device 101 , base band video or audio data, associated with plural programs Pa to Pn, are 
15 sent from a server or a video camera. These video or audio data are sent to video encoders 1 02a to 1 02n and to audio 
encoders 1 03a to 1 03n, associated with the programs Pa to Pn, respectively, so as to be encoded to compressed data 
streams (elementary streams) conforming to, for example, MPEG (ISO/IEC1 1 172, 1S0133818). 
[0005] The encoded elementary streams are sent to degree-one multiplexers 104a to 104n, associated with the pro- 
grams Pa to Pn, respectively. The degree-one multiplexers 1 04a to 1 04n time-divisionally multiplex elementary streams, 
20 supplied on the program basis, in terms of the transport packets prescribed by IS01381 8-1 as unit, to generate degree- 
one multiplexed streams associated with the respective programs Pa to Pn. 

[0006] The degree-one multiplexed streams, generated by the degree-one multiplexers 104a to 104n, are sent to a 
degree one multiplexer 105 which then time-divisionally multiplexes the degree-one multiplexed streams on the packet 
basis to generate a sole degree-two multiplexed stream. 
25 [0007] This degree one multiplexer 105 sends the generated degree two multiplexed stream via the transmission 
medium to a reception device 111. 

[0008] The degree-one multiplexed streams, generated by the degree-one multiplexers 104a to 104n, are sent to a 
degree-two multiplexer 105, which then time-divisionally multiplexes the respective degree-one multiplexed streams on 
the transport packet basis to generate a sole degree-two multiplexed stream. 
30 [0009] The degree-two multiplexer 105 sends the generated degree-two multiplexed stream via a transmission 
medium 1 1 0 to a reception device 111. 

[0010] The degree-one multiplexed streams and the degree-two multiplexed stream, obtained on multiplexing by the 
degree-one multiplexers 104a to 104n and the degree-two multiplexer 105, respectively, conform to the transport 
stream prescribed in IS013818-1. 
35 [001 1 ] The transmission device 101 thus encodes the base-band video or audio data, associated with the programs 
Pa to Pn, to generate a sole degree-two multiplexed stream, which is sent to the reception device 1 1 1 via transmission 
medium 110. 

[0012] The degree-two multiplexed stream is transmitted via the transmission medium 1 10 to the reception device 
111. Specifically, the degree-two multiplexed stream is sent to a separator 1 12. The separator 1 1 2 separates only the 
40 elementary stream associated with the program specified by the viewer from the degree-two multiplexed stream to send 
the separated elementary stream to a decoder. That is, the separator 1 12 sends the video elementary stream of the 
specified program to a video decoder 113, while sending the audio elementary stream of the specified program to an 
audio decoder 114. 

[001 3] The video decoder 113 and the audio decoder 114 expand or decode the compressed or encoded data to gen- 
45 erate baseband video and audio data which are sent to an external equipment, not shown. 

[0014] The reception device 1 1 1 thus receives the supplied degree-two multiplexed stream to select the predeter- 
mined program from the plural programs contained in the degree-two multiplexed stream by way of decoding. 
[001 5] Fig.2 shows data structures of the degree-one multiplexed streams and the degree-two multiplexed stream, as 
the transport stream prescribed by the IS013818-1. 
so [0016] The video elementary streams, encoded by the video encoders 102a to 102n, and audio elementary streams, 
encoded by the audio encoders 103a to 103n, are split into packets termed PES packets. The associated degree-one 
multiplexers 1 04a to 1 04n split the elementary streams into fixed-length transport packets, each being of 1 88 bytes, and 
time-divisionally degree-one multiplex the elementary streams on the transport packet basis to generate degree-one 
multiplexed streams. The degree-two multiplexer 105 time-divisionally degree-two multiplexes the respective degree- 
55 one multiplexed streams on the transport packet basis to generate the degree-two multiplexed stream. 

[0017] Fig.3 shows a decoder model of the reception device 111 in case the transport stream prescribed by the 
above-mentioned IS0 1381 8-1 is supplied thereto. 

[0018] A splitter 1 12 selects only the transport packets associated with the program and which have been selected 
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by the viewer from the degree-two multiplexed stream to distribute the selected packets to transport buffers 1 16 to 118. 
These transport buffers 1 1 6 to 1 18 transiently store the transport packets of the associated data. Specifically, the trans- 
port buffer 1 1 6 stores the transport packet of video data of the selected program, the transport buffer 1 1 7 stores the 
transport packet of audio data of the selected program and the transport buffer 1 18 storefe the transport packet of pro- 
5 gram control data of the selected program. Although the transport buffer for title data etc is not shown, transport packets 
of title data, for example, if contained in the selected program, are stored in the associated transport buffers. 
[0019] Each of the transport buffers 1 16 to 1 18 has a capacity of, for example, 512 bytes, and proceeds to leak the 
PES packets at a prescribed rate as long as data are stored therein. 

[0020] The video data leaked from the transport buffer 1 16 is sent to a multiplexing buffer 1 19. The audio data and 
.10 the program control data, leaked from the transport buffers 117, 118, are sent to associated elementary buffers 121 , 
122, respectively. 

[0021 ] From the multiplexing buffer 1 1 9, only the elementary stream is leaked at a prescribed bitrate so as to be sent 
to the elementary buffer 120. 

[0022] At each decoding time point, decoders 1 23 to 1 25 extract elementary streams from the associated elementary 
75 buffers 120, 121, 122, every decoding unit (termed an accessing unit) or every picture unit if the data is video data, in 
order to carry out decoding. The video data is decoded, using a re-order buffer 126, for chronologically displaying pic- 
tures. The base-band video and audio data and control data, thus decoded, are sent to an external equipment or to a 
system controller. 

[0023] By the above-described model, the reception device 111 decodes the transport stream prescribed by the 
20 above-mentioned ISOl 381 8-1. 

[0024] In the above<iescribed broadcast system, employing digital satellite broadcast, it is possible to transmit trans- 
port streams, obtained on multiplexing data compressed every plural programs by the transmitting device 101, and to 
demultiplex and decode the data by the reception device 111. 

[0025] Meanwhile, the total size of the multiplexing buffer 119 and the elementary buffer 120(121, 122) is the sum of 
25 the buffer size of the video buffering verifier (VBV) for controlling the amount of the generated codes and a size uniquely 
determined by the profile and the level prescribed in IS013818-2. This sum is referred to hereinafter as a decoder 
buffer. Thus, each encoder of the transmitting device 101 controls the amount of the generated codes so as to prevent 
underflow or overflow of the decoder buffer, that is so as not to cause failure of the decoder buffer. The degree-one mul- 
tiplexers 104a to 104n similarly perform scheduling and multiplexing such as to evade underflow or overflow of the 
30 decoder buffer. 

[0026] Meanwhile, in a multiplexing system used in the above-described broadcast system, that is in a multiplexing 
system in which degree-one multiplexed streams are further multiplexed to produce a sole degree-two multiplexed 
stream, there is produced, for the following reason, a time deviation between an output timing of the degree-one multi- 
plexed streams, scheduled by the degree-one multiplexers, and an output timing of the degree-one multiplexed streams 
35 multiplexed into the degree-two multiplexed stream. 

[0027] Specifically, there is produced, in this degree-two multiplexing system, a time deviation between respective out- 
put timings of the degree-one multiplexed streams multiplexed into the degree-two multiplexed stream due to the facts 
that degree-two multiplexing is possible only in transport-packet-based time slots in the bitrate of the degree-two multi- 
plexed stream, the bitrate of the degree-two multiplexed stream is higher than that of the degree-one multiplexed 
40 streams, and that, since it is only the transport packet of a sole degree-one multiplexed stream that can be degree-two 
multiplexed into a given time slot, the transport packet of the degree-one multiplexed stream outputted by the degree- 
one multiplexer substantially simultaneously is kept in a waiting state. This time deviation between the output timings of 
the degree-one multiplexed streams scheduled by the respective degree-one multiplexers and the output timings of the 
degree-one multiplexed streams multiplexed into the degree-two multiplexed stream is termed a degree-two multiplex- 
es ing jitter. 

[0028] Thus, even if, in the multiplexing system, the respective degree-one multiplexers are scheduled for multiplexing 
so as not to cause failure of the decoder buffer provided upstream of the decoder, the decoder buffer is susceptible to 
failure under the effect of deviation caused by the degree-two multiplexing jitter in the arrival timing of the data stream 
at the decoder buffer or under the effect of deviation in the time reference encoded in the degree-two multiplexed stream 
so or in the program check reference (PCR) in the case of the transport stream prescribed in IS013818-1 . 
[0029] These two effects in the multiplexing system are scrutinized in more detail. 

[0030] Referring first to Figs.4A to 4D, the deviation in the arrival timing of the data stream at the decoder buffer due 
to degree-two multiplexing jitter is explained. Meanwhile, Figs.4A to 4D illustrate a degree-one multiplexed stream of a 
predetermined program into which are multiplexed a video elementary stream and an audio elementary stream, a 
55 degree-two multiplexed stream into which are multiplexed the above-mentioned predetermined program and other pro- 
grams, the buffer occupation volume of the decoder buffer envisaged by the degree-one multiplexers and the buffer 
occupation volume of the decoder buffer corrupted with the degree-two multiplexing jitter, respectively. 
[0031] The degree-one multiplexed stream is video or audio data multiplexed every transport packet (N, N+1, N+2, 
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N+3, • • • ) constituted by the packet header and the elementary stream, as shown in Fig. 4 A. 
[0032] The degree-two multiplexed stream is composed of degreeone multiplexed streams shown in Fig.4A and other 
degree-one multiplexed streams, degree-two multiplexed at a bitrate higher than the bitrate of the degree-one multi- 
plexed streams, as shown in Fig.4B. 
5 [0033] It is noted that the degree-one multiplexed streams are scheduled and multiplexed so as not to produce over- 
flow or underflow in the decoder buffer. Thus, the video data contained in the pre-set transport packet, such as the 
transport packet N+1, is decoded without causing failure of the decoder buffer, while audio data contained in the pre- 
set transport packet, such as the transport packet N+3, is also decoded without causing failure of the decoder buffer, 
as shown in Fig.4C. 

w [0034] However, since the degree-two multiplexed stream is of a bitrate higher than the degree-one multiplexed 
streams, the packet data storage end timing of the degree-two multiplexed stream is occasionally earlier than that of the 
degree-one multiplexed streams, even if the input start timing of the transport packet into the decoder buffer in the 
degree-two multiplexed stream is the same as that in the degree-one multiplexed streams. The result is that the end 
timing of packet data storage into the decoder buffer becomes faster than the timing envisaged by the degree-one mul- 

15 tiplexers. Thus, the end timing of packet data storage in the decoder buffer becomes faster than the timing envisaged 
by the degree-one multiplexers. In such transport packet, such as transport packet N+1 , the buffer occupation volume 
exceeds the decoder buffer size to produce overflow, as shown in Fig.4D. 

[0035] Also, since the degree-two multiplexed stream is corrupted with the degree-two multiplexing jitter, the transport 
packet input start timing to the decoder buffer is occasionally later than that in the degree-one multiplexed streams, 
20 such that the packet data storage start timing to the decoder buffer is later than the timing envisaged by the degree-one 
multiplexed streams. In such transport packet, such as transport packet N+3, the buffer occupation volume is smaller 
than zero, as shown in Fig.4D, thus producing the underflow. 

[0036] Next, the description is made of the deviation produced in the time reference value (PCR) encoded in the 
degree-two multiplexed stream due to the degree-two multiplexing jitter. 

25 [0037] The PCR is encoded into the packet header of a predetermined transport packet, as shown in Fig.4A. This 
PCR denotes the data input time to a decoder. The decoder of the reception device is actuated in synchronism with sys- 
tem clocks of the reception device based on the actual input timing of byte data including the last bit of the PCR base 
field and on the PCR value. That is. both the value itself of the PCR and the arrival timing of the PCR at the decoder, 
that is the timing of actual output timing of the multiplexer, are meaningful. Therefore, if degree-two multiplexing jitter is 

30 produced in the transport packet, into which is encoded the PCR, such as the transport packet N+2 shown in Fig.4, 
there is produced time deviation between the PCR output timing and the value of the PCR shown in Fig.4B, such that 
synchronization cannot be achieved in the decoder. The IS013138-1 provides that only the PCR deviation up to ±500 
nanosecond is allowable. 

[0038] Thus, in the conventional multiplexing system, the following processing is generally adopted in order to over- 
35 come the inconveniences of deviation in data stream arrival timing at the decoder buffer and of deviation of the time ref- 
erence PCR encoded in the degree-two multiplexed stream. 

[0039] That is, in the conventional multiplexing system, an imaginary buffer occupation volume of the decoder buffer 
is presumed, in generating the degree-one multiplexed streams by the degree-one multiplexers, and a pre-set margin 
is provided for each of the upper and lower values of the buffer occupation volume of the decoder buffer in order to effect 

40 multiplexing. The result is that, in the conventional multiplexing system, such a degree-two multiplexed stream is pro- 
duced which does not produce failure in the decoder buffer even if the data stream arrival timing at the decoder buffer 
is earlier or later due to the degree-two muliplexing jitter. Also, in the conventional multiplexing system, a PCR correction 
unit for correcting the PCR of the degree-two multiplexed stream is provided downstream of the degree-two multiplexer. 
The result is that if in the conventional multiplexing system, the PCR is deviated due to the degree-two multiplexing jitter, 

45 such a degree-two multiplexed stream can be realized which enables synchronization to be achieved at the decoder of 
the reception device. 

[0040] Referring to Fig.5, a conventional multiplexing system 150 which overcomes these two problems is explained. 
[0041] The conventional multiplexing system 150 includes plural degree-one multiplexers 151a to 151 n and a degree- 
two multiplexer 1 52. This degree-two multiplexer 1 52 is made up of reception memories 1 53a to 1 53n, associated with 

so the degree-one multiplexers 1 51 a to 1 51 n, respectively, a switching unit 1 54 for switching between the degree-one mul- 
tiplexed streams stored in the reception memories 153a to 153n to multiplex the selected degree-one multiplexed 
streams, a time information correction unit 155 for correcting the PCR of the degree-two multiplexed stream generated 
by the switching unit 154, and a clock generator 156 for generating system clocks of the degree-two multiplexer 152. 
[0042] In this multiplexing system 150. the system clocks accorded to the degree-one multiplexers 151a to 151n are 

55 synchronized with the system clocks generated by the clock generator 1 56 so that time management is achieved by the 
same clocks. 

[0043] The degree-one multiplexers 151ato151n provide a pre-set margin for each of the upper and lower values of 
the buffer occupation volume of the data buffer to generate degree-one multiplexed streams of code volumes which do 
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not cause the failure of the decoder buffer. The degree-one multiplexed streams are sent to the associated reception 
memories 153a to 153n. 

[0044] The reception memories 1 53a to 1 53n transiently store the degree-one multiplexed streams generated by the 
degree-one multiplexers 151a to 151 n. 
5 [0045] The switching unit 154 is responsive to a repetitive pattern of transport packets repeated at a pre-set period, 
referred to hereinafter as an interleaving pattern, to select the degree-one multiplexed streams stored in reception 
memories 153a to 153n. This switching unit 154 multiplexes the selected transport packets to generate a degree-two 
multiplexed stream. 

[0046] The time information correction unit 155 rewrites the value of the PCR of the degree-two multiplexed stream 
10 generated by the switching unit 154 to the actual outputting timing of the degree-two multiplexer 150. 

[0047] The clock generator 156 generates system clocks of the degree-two multiplexer 152. Therefore, the degree- 
two multiplexed stream, generated by the degree-two multiplexer 152, is synchronized with system clocks generated by 
the clock generator 156. Fig.6 shows an instance in which two degree-one multiplexed streams with bitrates of 6 Mbps 
and 4 Mbps are multiplexed by the conventional multiplexing system 150 to a sole degree-two multiplexed stream hav- 
15 ing a bitrate of 1 0 Mbps. 

[0048] The degree-two multiplexed stream is multiplexed in accordance with a pre-set interleaving pattern with a delay 
of a pre-set degree-two multiplexing delay relative to the degree-one multiplexed streams. This interleaving pattern is 
made up of five transport packets, namely three transport packets of the degree-one multiplexed streams having a 
bitrate of 6 Mbps and two transport packets of the degree-one multiplexed streams having a bitrate of 4 Mbps. In this 

20 degree-two multiplexed stream, since the degree-two multiplexing jitter is not zero for the totality of the transport pack- 
ets, the PCR value encoded in the degree-one multiplexed streams is rewritten by the time information correction unit 
155 to the correct value of PCR at an output timing of the degree-two multiplexer. In addition, the respective degree-one 
multiplexed streams and the degree-two multiplexed stream are generated on the basis of the system clocks synchro- 
nized with each other, so that, for example, the interleaving pattern time width are the same for the degree-one multi- 

25 plexed streams and the degree-two multiplexed stream. 

[0049] With the conventional multiplexing system 1 50, described above, the bitstream is multiplexed with pre-set mar- 
gin by the respective degree-one multiplexers 1 51 a to 151 n to prevent failure of the decoder buffer. In addition, the PCR 
value is written by the time information correction unit 156 to generate the degree-two multiplexed stream for which the 
decoder buffer failure is not caused and for which synchronization with the transmission device can be achieved on the 

30 side of the decoder. 

[0050] Meanwhile, if, in an asynchronous system in which system clocks for actuating the degree-one multiplexers 
1 51 a to 1 51 n and those for actuating the degree-two multiplexer 1 52 are not synchronized with each other, the degree- 
two multiplexed stream is generated in accordance with the interleaving pattern, as described above, there is produced 
timing deviation in the degree-two multiplexing due to the difference in the system clocks, in addition tot the multiplexing 
35 jitter generated in the synchronization system. 

[0051 ] The problem caused by timing deviation in the degree-two multiplexizing due to difference in the system clocks 
produced in an asynchronous multiplexing system doing the processing of the degree-one multiplexing and that of the 
degree-two multiplexing asynchronously is hereinafter explained. 

[0052] First, an instance m which the system clocks Cp' of the degree-one multiplexers is faster than the system clock 
40 Cr of the degree-two multiplexer is explained with reference to Fig.7A showing degree-one multiplexed streams with the 
synchronous system ( Cp = Cr ) and to Fig.7B. Meanwhile, the system clocks for degree-one multiplexing of the syn- 
chronous system and those for degree-one multiplexing of the asynchronous system are denoted as Cp and Cp*, 
respectively. 

[0053] The degree-one multiplexers output degree-one multiplexed streams of the bitrate P based on the system 
45 clocks Cp'. The degree-two multiplexer multiplexes the degree-one multiplexed streams of the bitrate p in accordance 
with the interleaving pattern to generate a degree two multiplexed stream. It is noted that, if system clocks Cp of the 
degree-one multiplexers are synchronized with the system clocks Cr of the degree-two multiplexer, the degree-two mul- 
tiplexing jitter is produced, as shown in Fig.7A, however, the transport packets of the degree-one multiplexed streams, 
generated every interleaving pattern, are degree-two multiplexed in the interleaving patterns, such that there is pro- 
50 duced no deviation in the degree-two multiplexing timing due to the difference m the system clocks. However, in the 
asynchronous multiplexing system in which the system clocks Cp' of the degree-one multiplexers are faster than the 
system clocks Cr of the degree-two multiplexer, more data of the degree-one multiplexers than are degree-two multi- 
plexed in accordance with the interleaving pattern are produced, as shown in Fig.7B. For example, two more transport 
packets a8. a9 are generated in the degree-one multiplexed streams at a time point when the degree-two multiplexing 
55 of the four interleaving patterns has come to a close, as shown in Fig.7B. The transport packets a8, a9. thus produced, 
are accumulated at this point in the reception memories. Thus, if degree-two multiplexing timing deviation is produced 
due to difference in the system clocks, the data which has failed to be degree-two multiplexed are accumulated in the 
reception memories, in a manner distinct from the degree-two multiplexing jitter in the above-described synchronous 
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system, thus causing overflow of the reception memories. 

[0054] If such deviation in the degree-two multiplexing jitter due to the difference in the system clocks is produced, 
the degree-two multiplexer is compelled to correct the PCR as it accumulates the deviation tune. The result is that the 
difference between the PCR encoded by the degree-one multiplexers and the PCR' corrected by the degree-two multi- 
plexer keeps on to be increased. That is, since the value of the PCR corrected by the degree-two multiplexer keeps on 
to be increased despite the fact that the degree-one multiplexers have presupposed this decoding buffer in scheduling 
in order to encode the PCR, it becomes impossible to maintain correct matching with respect to the decoding time pre- 
scribed every decoding unit such as in a video frame such that the decoder buffer of the reception side undergoes over 
flowing or underflowing. 

[0055] Referring to Figs.8A and 8B, the case in which the system clocks Cp* are slower than the system clocks Cr of 
the degree-two multiplexer. Figs.8a and 8b show degree-one multiplexers of the synchronous system (Cp =Cr ) and 
degree-one multiplexed streams and a degree two multiplexed stream of the asynchronous system ( Cp* <C r), respec- 
tively. 

[0056] The degree-one multiplexers output a degree-one multiplexed streams of a bitrate P based on the system 
clocks Cp\ The degree-two multiplexer multiplexes the degree-one multiplexed streams of the bitrate P in accordance 
with the interleaving pattern to generate a degree-two multiplexer. It is noted that, if the system clocks Cp of the degree- 
one multiplexers are synchronized with the system clocks Cr of the degree-two multiplexer, degree-two multiplexing jit- 
ter is produced, as shown in Fig.8A, however, the transport packets of the degree-one multiplexed streams generated 
every interleaving pattern are degree-two multiplexed in the interleaving patterns, such that deviation in the degree-two 
multiplexing timing due to the difference m the system clocks is not produced. 

[0057] However, in an asynchronous multiplexing system in which the system clocks Cp' of the degree-one multiplex- 
ers are slower than the system clocks Cr of the degree-two multiplexer, as shown in Fig.8B, data of the degree-one mul- 
tiplexed streams are generated at a rate slower than the rate of degree-two multiplexing in accordance with the 
interleaving pattern. For example, data for degree-two multiplexing are not generated as from a mid point of the trans- 
port packet a5 t as shown in Fig.8B, such that degree-two multiplexing cannot be achieved in accordance with the inter- 
leaving pattern. Therefore, the deviation in the degree-two multiplexing due to the difference in the system clocks is 
such that data of the degree-one multiplexed streams cannot reach the reception memories at the degree-two multi- 
plexing timing, in a manner distinct from the degree-two multiplexing jitter in the above-described synchronous system, 
thus ultimately causing underflow of the reception memories. 

[0058] If the difference in the degree-two multiplexing timing due to the difference in the system clocks is produced, 
the degree-two multiplexer has to correct the PCR as it accumulates the deviation time. Thus, the difference between 
the PCR encoded by the degree-one multiplexers and the PCR' corrected by the degree-two multiplexer keeps on to be 
increased. The result is that the value of the PCR corrected by the degree-two multiplexer keeps on to be increased 
even although the degree-one multiplexers presuppose the decoder buffer to effect the scheduling to encode the PCR, 
so that matching to the decoding time provided each decoding unit as in a video frame or to the other time information 
appended to the stream cannot be maintained to cause the overflow or the underflow of the reception side decoding 
buffer. 

[0059] Up to now, the system clocks Cp of the degree-one multiplexers is generally synchronized with the video frame 
timing (V sync), while the system clocks Cr of the degree-two multiplexer are the send-out clocks of the degree two mul- 
tiplexed stream and generally depend on the transmission medium. Moreover, in a conventional broadcasting station, 
expensive equipments are used, such that the system clocks Cp of the totality of the degree-one multiplexers can be 
easily synchronized with the system clocks Cr of the degree-two multiplexer. However, in keeping up with the increased 
number of channels of the digital television broadcast, coming into widespread use of the personal computers and with 
the increased frequency bandwidth of the household network, there is raised a demand for constructing a multiplexing 
system by a simpler system configuration and for a multiplexing system operating satisfactorily even if the degree-one 
multiplexers are not synchronized with the degree-two multiplexer. 

[0060] Moreover, if the system clocks Cp of all of the degree-one multiplexers are to be restored by the degree-two 
multiplexer, a number of PLLs equal to the number of the degree-one multiplexers is required. Moreover, for keeping the 
PLL in operating state, the degree-one multiplexed streams need to be transferred in real-time. If, for example, the 
transfer to the reception memories and arrival of the PCR are delayed, the PLLs restore the clocks slower than the sys- 
tem clocks Cp of the degree-one multiplexers. Therefore, transfer of the degree-one multiplexed stream data from the 
degree-one multiplexers to the reception memories needs to use a dedicated transfer system which assures transfer in 
real-time. However, the pre-existing buses, such as peripheral component interconnect (PCI), a transfer bus preferen- 
tially used in a personal computer etc, transfer the data in a burst-like fashion. Thus, a demand is raised for an asyn- 
chronous system that is able to use the burst-like data transfer. 

[0061 ] It is therefore an object of at least preferred embodiments of the present invention to provide a signal multiplex- 
ing method and apparatus, a digital signal transmission method and apparatus, a digital signal recording method and 
apparatus and a recording medium having the multiplexed data recorded thereon, in which the degree-one multiplexed 
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streams can be multiplexed without disrupting the processing carried out on the reception or decoding sides. 
[0062] With the digital signal multiplexing method and apparatus according to at least preferred embodiments of the 
present invention, degree-one multiplexed streams, obtained on time-divisionally multiplexing a bitstream of one or 
more digital signals and to which is attached a time reference value, are received from plural degree-one multiplexers. 

5 Be received degree-one multiplexed streams are time-divisionally multiplexed, based on a repetitive pattern associated 
with the bitstream of each degree-one multiplexed stream, to generate a degree two multiplexed stream. The time ref- 
erence value attached to the degree two multiplexed stream is corrected based on reference clocks not synchronized 
with reference clocks adapted for operating the degree-one multiplexers. If the corrected time reference value is larger 
than the time reference value attached to the degree-one multiplexed stream by more than a predetermined value, the 

io preset volume of the dummy data is multiplexed. 

[0063] With the present digital signal multiplexing method, the pre-set volume of the dummy data is multiplexed if the 
corrected time reference value becomes larger by more than a pre-set value than the time reference value attached by 
the degree-one multiplexers to the degree-one multiplexed streams, such that there is generated a degree two multi- 
plexed stream to which is attached the corrected time reference value which is not larger by more than the pre-set value 

is than the time reference value attached by the degree-one multiplexers to the degree-one multiplexed streams. 

[0064] Embodiments of the invention will now be described, by way of example only, with reference to the accompa- 
nying drawings in which: 

Fig.1 is a block diagram showing a broadcast system for transmitting a transport stream used in a digital satellite 
20 broadcasting. 

Fig.2 shows a data structure of degree-one multiplexed streams, as transport streams prescribed by the IS01381 8- 
1 , and a degree-two multiplexed stream. 

Fig. 3 is a block diagram for illustrating a decoder model of the broadcasting system. 

Figs.4.A to AD illustrate data structures of the degree-one multiplexed streams and the degree-two multiplexed 
25 stream and the buffer occupation volume of a decoder buffer for illustrating the problem due to the effect of the 
degree-two multiplexing jitter. 

Fig.5 is a block diagram showing a conventional multiplexing system. 

Fig.6 illustrates a degree two multiplexed stream generated by the conventional multiplexing system. 

Figs.7A and 7B illustrate a degree two multiplexed stream generated in a case wherein the system clocks of the 

30 degree-one multiplexers are faster than the system clocks of the degree-two multiplexer. 

Figs.8A and 8B illustrate a degree two multiplexed stream generated in a case wherein the system clocks of the 

degree-one multiplexers are slower than the system clocks of the degree-two multiplexer. 

Fig.9 is a block diagram of a multiplexing system embodying one example of the present invention. 

Figs.lOA and 10B illustrate the operation of dummy packet insertion in the multiplexing system of Fig.9. 

35 Figs. 1 1 A to 1 1 D illustrate the bitrate of the degree-one multiplexed streams outputted by the degree-one multiplex- 
ers of the multiplexing system. 

[0065] Referring to the drawings, preferred embodiments of the multiplexing system according to the present invention 
will be explained in detail. 

40 [0066] This multiplexing system is applied to a digital satellite broadcast system of transmitting a transport stream 
made up of data multiplexed in terms of plural programs, such as television broadcast programs or channels, as a unit, 
and to a recording system for recording the transport stream on a recording medium. This multiplexing system is such 
a system in which plural degree-one multiplexed streams obtained on time-divisionally multiplexing compressed audio 
or video data streams, that is elementary streams, are further time-divisionally multiplexed to produce a sole degree- 

45 two multiplexed stream usable by a sole transponder. Here, data contained in the degree-one multiplexed streams are 
equivalent to the sole channel or program of the above-mentioned television broadcast. Meanwhile, in the following 
explanation, the degree-one multiplexed streams and the degree-two multiplexed stream are assumed to be data 
streams corresponding to the transport streams, prescribed in IS013818-1 . 

[0067] First, a multiplexing system according to a first embodiment of the present invention is explained with reference 
so to the drawings. 

[0068] Fig.9 shows the block diagram of the multiplexing system according to a first embodiment of the present inven- 
tion. 

[0069] The multiplexing system 1 includes plural degree-one multiplexers 2a to 2n, for generating degree-one multi- 
plexed streams, and a degree-two multiplexer 3 for further multiplexing the degree-one multiplexed streams generated 
55 by the degree-one multiplexers 2a to 2n to generate a degree-two multiplexed stream. The degree-two multiplexer 3 
includes plural reception memories 4a to 4n for receiving the degree-one multiplexed streams generated by the degree- 
one multiplexers 2a to 2n to store the received streams transiently, and a switching unit 5 for selecting the degree-one 
multiplexed streams stored in the reception memories 4a to 4n to degree two multiplex the selected degree-one murti- 
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plexed streams. The degree-two multiplexer 3 also includes a time information correction unit 6 for correcting the PCR 
of the degree-two multiplexed stream generated by the switching unit 5 and a clock generator 7 for generating system 
clocks for the degree-two multiplexer 3. 

[0070] In this multiplexing system 1 , the system clocks Cp 1 to Cpn, accorded to the degree-one multiplexers 2a to 
5 2n, respectively, and system clocks Cr, generated by the clock generator 7, are not synchronized with one another, such 
that time management is performed independently for the degree-one multiplexers 2a to 2n and the degree-two multi- 
plexer 3. 

[0071] The respective degree-one multiplexers 2a to 2n provide pre-set margins to upper and lower limit values of the 
buffer occupation volume of the decoder buffer in order to generate degree-one multiplexed streams of such code voi- 
re umes as not to cause failure of the decoder buffer. The respective degree-one multiplexed streams are sent to associ- 
ated reception memories 4a to 4n. Meanwhile, the degree-one multiplexers 2a to 2n operate on the basis of respective 
independent system clocks Cp1 to Cpn, so that the degree-one multiplexed streams generated by these degree-one 
multiplexers 2a to 2n are synchronized with the system clocks Cpl to Cpn. 

[0072] The reception memories 4a to 4n transiently store the degree-one multiplexed streams generated by the 

15 degree-one multiplexers 2a to 2n. 

[0073] The switching unit 5 is responsive to the transport packet repetition pattern, determined by the bitrate of each 
degree-one multiplexed stream and which is repeated at a pre-set period (referred to hereinafter as an interleaving pat- 
tern), to select the degree-one multiplexed streams stored in the reception memories 4a to 4n. The switching unit 5 mul- 
tiplexes the selected transport packet to generate the degree two multiplexed stream. 

20 [0074] The time information correction unit 6 rewrites the values of the PCR of the degree two multiplexed stream 
generated by the switching unit 5 to correct values in order to correct the PCR value. That is, the time information cor- 
rection unit 6 rewrites the value of the PCR encoded in accordance with the outputting timing of the degree-one multi- 
plexed streams from the respective degree-one multiplexers 2a to 2n (PCR) to the value of the PCR matched to the 
outputting timing of the degree two multiplexed stream from the degree-two multiplexer 3 (PCR*). 

25 [0075] The clock generator 7 generates the system clocks Cr of the degree-two multiplexer 3, so that the degree two 
multiplexed stream generated by the degree-two multiplexer 3 are synchronized with the system clocks Cr generated 
by the clock generator 7. The values of the PCR rewritten by the time information correction unit 6 are synchronized 
with the system clocks Cr generated by the clock generator 7. 

[0076] The time information correction unit 6 compares the pre-correction PCR and the post-correction PCR* in order 
30 to correct the degree-two multiplexing timing deviation caused by the difference in the system clocks of the degree-one 
multiplexers 2a to 2n and those of the degree-two multiplexer 3. If the difference between the pre-correction PCR, as 
an output timing value of a given degree-one multiplexed streams and the post-correction PCR', as an output timing of 
the degree two multiplexed stream, is in excess of a predetermined threshold value, the time information correction unit 
6 gives this information to the switching unit 5. When fed with this information, the switching unit 5 inserts a dummy 
35 packet in place of the transport packet of the degree-one multiplexed stream the difference of the PCR of which has 
exceeded a threshold value. That is, the switching unit 5 inserts this dummy packet into a packet on the interleaving pat- 
tern into which this degree-one multiplexed stream was scheduled to be degree-two multiplexed next time. This dummy 
packet is a null packet prescribed in, for example, IS0818-1. This null packet is not inputted into the decoder buffer but 
is simply read and disregarded without affecting the decoding processing. 
40 [0077] The time information correction unit 6 performs this correcting and comparing operations on the PCRs 
encoded in the totality of the degree-one multiplexed streams. 

[0078] The operation of inserting dummy packets in this multiplexing system 1 is now explained with reference to 
Figs. 1 0A and 10B as comparison is made between the synchronous system and the asynchronous system. Fig. 1 0A 
shows the degree-one and degree-two multiplexed streams for the synchronous system and Fig. 1 0B shows the degree- 

45 one and degree-two multiplexed streams in this major surface 1 which is the a synchronous system. 

[0079] In the case of the synchronous system in which the system clocks Cp of the degree-one multiplexers are syn- 
chronized with the system clocks Cr of the degree-two multiplexer, the degree-two multiplexing timing deviation is only 
the degree-two multiplexing jitter, with the deviation not being accumulated, by performing degree-two multiplexing in 
accordance with the interleaving pattern as set based on the bitrate assigned to the degree-one multiplexers, as shown 

so in Fig. 1 0A. 

[0080] In the case of the asynchronous system in which the system clocks of the degree-one and degree-two multi- 
plexers are not synchronized with each other, the degree-two multiplexing jitter deviation due to the asynchronous sys- 
tem clocks is accumulated if degree-two multiplexing is executed in accordance with the interleaving pattern. 
[0081] This multiplexing system 1 compares the encoded pre-correction PCR value, encoded on the basis of the out- 
55 putting timing of the degree-one multiplexed streams, to the post-correction PCR', as corrected by the time information 
correction unit 6 of the degree-two multiplexer 3. Meanwhile, if, in the major surface 1 , there is no degree-two multiplex- 
ing timing deviation, the delay until starting of the degree-two multiplexing, that is degree-two multiplexing delay, is 
added as an offset to the PCR' to equate the pre-correction PCR value to the post-correction PCR'. The reason is that, 
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unless the offset corresponding to the degree-two multiplexing delay is used, the PCR decoded into the degree-one 
multiplexed streams cannot be matched to the decoding time or the other time information. 

[0082] In the difference between the pre-correction PCR encoded into the degree-one multiplexed streams and the 
PCR* generated by the time information correction unit 6, there are contained the degree-two multiplexing jitter and the 

5 degree-two multiplexing timing deviation produced by the difference in the system clocks proper to the asynchronous 
system. The degree-two multiplexing jitter is produced in the synchronous system, as discussed above, and can be 
found based on the interleaving pattern. Therefore, the degree-two multiplexing timing deviation produced by the differ- 
ence in the system clocks proper to the asynchronous system can be found from the difference between the pre-cor- 
rection PCR encoded in the degree-one multiplexed streams and PCR' generated by the time information correction 

w unit 6 and from the degree-two multiplexing jitter produced in this synchronous system. The time information correction 
unit 6 compares the degree-two multiplexing timing deviation produced by the difference in the system clocks and a pre- 
set threshold for this deviation. If the deviation surpasses this threshold value, a dummy packet (null packet) is inserted 
into the transport packet of the degree two multiplexed stream into which was scheduled to be multiplexed the transport 
packet responsible for this deviation. 

is [0083] Specifically, no particular correction processing is performed on the PCR(k) encoded in the transport packet k 
or on the PCR'(k) encoded in the transport packet following degree-two multiplexing of the transport packet k, because 
the degree-two multiplexing timing deviation due to the difference in the system clocks is not larger than the threshold 
value, as shown in Fig. 10B. On the other hand, the degree-two multiplexing timing deviation due to the difference in the 
system clocks between the PCF(n) encoded in the transport packet and the PCR' (n) encoded in the transport packet 

20 following the degree-two multiplexing of the transport packet (n) is not less than a threshold value. Therefore, the 
dummy packet (null packet) is inserted into a transport packet of a degree two multiplexed stream, into which the trans- 
port packet of the degree two multiplexed stream was scheduled to be degree-two multiplexed in the inherent interleav- 
ing pattern. A transport packet n+1 of the degree-one multiplexed stream is degree-two multiplexed into the transport 
packet of the degree two multiplexed stream, into which a transport packet n+2 of the degree-one multiplexed stream 

25 was inherently scheduled to be degree-two multiplexed. Subsequently, degree-two multiplexing is continued as the 
transport packets incremented by one each time are degree-two multiplexed. 

[0084] Meanwhile, the degree-two multiplexing timing deviation due to the difference in the system clocks can be min- 
imized by setting the above threshold value so as to be equal to one-half the transport packet of the degree-one multi- 
plexed stream. That is, since the deviation between the output timing of the transport packet envisaged by the degree- 
30 one multiplexers 2a to 2n and the output timing of the transport packet of the transport packet outputted by the degree- 
two multiplexer 3 is the sum of the degree-two multiplexing jitter generated in the synchronous system and the maxi- 
mum value of the deviation caused by the difference of the system clocks, it is possible to set the maximum value of the 
sum of the deviation as being known from the outset. 

[0085] Therefore, in the multiplexing system 1 , pre-set margins are provided for the respective degree-one multiplex- 
35 ers 2a to 2n so that the decoder buffer will be prohibited against failure even if the deviation corresponding to the known 
maximum value of the deviation is produced in generating the degree two multiplexed stream, thereby constructing a 
safe system free from failure of the decoder buffer. 

[0086] Meanwhile, in the above-described processing of inserting dummy packets by the time information correction 
unit 6 based on PCR comparison, it is presumed that the degree-two multiplexing timing is faster than the output timing 

40 of the degree-one multiplexed streams, that is that the system clocks Cp1 to Cpn of the degree-one multiplexers are 
slower than the system clocks Cr of the degree-two multiplexer. In order to render this processing effective even in such 
cases wherein the degree-two multiplexing timing is slower than the output timing of the degree-one multiplexed 
streams, that is in which the system clocks Cp1 to Cpn of the degree-one multiplexers are faster than the system clocks 
Cr of the degree-two multiplexer, the degree-one multiplexers 2a to 2n of the multiplexing system 1 are designed to out- 

45 put degree-one multiplexed streams at a bitrate lower than the assigned bitrate. 

[0087] Referring to Fig.1 1 , the bitrate of the degree-one multiplexed streams outputted by the degree-one multiplexers 
2a to 2n in the multiplexing system lis explained. Specifically, Fig.1 1 A shows the bitrate (bit generation quantity per 
second) of the degree-one multiplexed streams in case the system clocks Cp are synchronized with the system clocks 
Cr, Fig.1 1 B shows the bitrate of the degree-one multiplexed streams in case the system clocks Cp are slower than the 

so system clocks Cr, Fig.1 1C shows the bitrate of the degree-one multiplexed streams in case the system clocks Cp are 
faster than the system clocks Cr and Fig.1 1 D shows the bitrate of the degree-one multiplexed streams in the multiplex- 
ing system 1. 

[0088] If the system clocks Cp are synchronized with the system clocks Cr, the time measured by the system clocks 
Cp is equal to that measured by the system clocks Cr, as shown in Fig.1 1 A, so that the bitrate of the degree-one mul- 
55 tiplexed streams outputted by the degree-one multiplexers 2a to 2n is kept unchanged with degree-two multiplexed out- 
put of the degree-two multiplexer 3. 

[0089] If the system clocks Cp of the degree-one multiplexers are slower than the system clocks Cr of the degree-two 
multiplexer, one second time as measured by the system clocks Cp is longer than the one-second time as measured 
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by the system clocks Cr, as shown in Fig.1 1 B. Therefore, the degree-one multiplexed streams, with the bitrate P, out- 
putted on the basis of the system clocks Cp, appear as degree-one multiplexed streams with the bitrate of (Cp/Cr) x P 
.when looking from the side of the system clocks Cr of the degree-two multiplexer. 

[0090] Conversely, if the system clocks Cp of the degree-one multiplexers are faster than the system clocks Cr of the 
5 degree-two multiplexer, one second time as measured by the system clocks Cp is shorter than the one-second time as 
measured by the system clocks Cr, as shown in Fig.11C. Therefore, the degree-one multiplexed streams, with the 
bitrate P, outputted based on the system clocks Cp, appear as degree-one multiplexed streams with the bitrate of 
(Cp/Cr) x P when looking from the side of the system clocks Cr of the degree-two multiplexer. 
[0091] Thus, the degree-one multiplexers 2a to 2n of the multiplexing systeml outputs a degree-one multiplexed 
io stream with a bitrate of p x P for the bitrate P assigned thereto based on the interleaving pattern. 
[0092] In the present multiplexing system 1 , this p is set as follows: 

[0093] If the system clocks of the actual degree-one multiplexers and the degree-two multiplexer are known from the 
outset, degree-two multiplexing can be realized in accordance with the interleaving pattern by setting the value of p to 
Cr/Cp. However, the system clocks of the degree-one multiplexers and the degree-two multiplexer are unknown such 
is that the system clocks per se are liable to be changed. Thus, this multiplexing system 1 exploits the fact that the clock 
oscillator has its precision defined in terms of an error range and sets the maximum value that can be taken by the sys- 
tem clocks to Cp MAX and the minimum value that can be taken by the system clocks of the degree-two multiplexer to 
CrMIN to set p to CrMIN/CpMAX based on these set values. 

[0094] Thus, if degree-one multiplexer outputs a degree-one multiplexed stream with a bitrate (CrMIN/CpMAX) x P , 
20 based on the system clocks Cp, it can be ensured that the degree-one multiplexed stream with the bitrate of 
(CrMIN/CpMAX) x P based on the system clocks Cp, when viewed from the side of the system clocks Cr of the 
degree-two multiplexer, is necessarily smaller in the bitrate than the bitrate P inherently assigned to the degree-one 
multiplexer, as shown by the following formula: 

25 (Cp/Cr)xpxP = (Cp/Cr) x (CrMIN/CpMAX) x P > P. 

[0095] If the bitrate of the degree-one multiplexed streams outputted by the degree-one multiplexers 2a to 2n is set 
as described above, it can be ensured that the degree-two multiplexing timing is faster than the output timing of the 
degree-one multiplexed stream. Thus, with the multiplexing system 1 , it is possible to correct the deviation caused by 
30 the difference in the system clocks by a processing of comparing the PCRs by the time information correction unit 6 and 
inserting a dummy packet without regard to the size of the system clocks Cp of the degree-one multiplexor and the sys- 
tem clocks Cr of the degree-two multiplexer. 

[0096] Thus, with the multiplexing system 1 embodying this example of the present invention, the degree two multi- 
plexed stream can be generated without disrupting the reception memories 4a to 4n or the decoder buffer. 

35 [0097] With the present multiplexing system 1 , in which the bitrate of the respective degree-one multiplexers can be 
changed by changing the interleaving pattern, while the interleaving pattern can be changed responsive to the bitrates 
of the respective degree-one multiplexed streams, it is possible to effect control by statistic multiplexing by performing 
control to provide a constant bitrate of the degree two multiplexed stream which represents the overall bitrate, with the 
degree-one multiplexed streams being variable. It is thus possible to distribute the bitrate depending on the encoding 

40 difficulty of the degree-one multiplexed streams to improve the overall picture quality. 

[0098] Also, since there is no necessity of restoring the system clocks of the respective degree-one multiplexers 2a 
to 2n using the PLL, the degree-one multiplexed streams can be transferred by a bus employing the burst-like data 
transfer system, such as a PCI bus. 

[0099] Also, in the multiplexing system 1 , in which the degree-two multiplexing delay sufficient to assure the arrival at 
45 the respective reception memories 4a to 4n of the degree-one multiplexed streams, burst-like properties in the data 
transfer of the degree-one multiplexed streams can be absorbed by the degree-two multiplexer 3 to enable data transfer 
of the degree-one multiplexed streams to be made using the totality of buses. 

[0100] In the above-described embodiment of the present invention, the degree-one multiplexed streams and the 
degree two multiplexed stream are transport streams provided in IS013818-1 . However, the present invention may be 

so applied not only to the transport stream provided in IS013818-1 but also to any degree-one multiplexed streams or 
degree two multiplexed stream obtained on time-divisionally multiplexing bitstreams of digital signals. 
[0101] In the above-described embodiment of the present invention, the time reference value encoded in the degree- 
one multiplexed streams and the degree two multiplexed stream is the PCR prescribed in IS013138-1. However, the 
present invention is not limited to the case the time reference value is the PCR prescribed in ISOl 3138-1 but may be 

55 applied to a case in which the time reference value is an arbitrary time reference attached to the bitstream. 
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Claims 

1. A digital signal multiplexing apparatus in which degree-one multiplexed streams are received from a plurality of 
degree-one multiplexers and in which the received degree-one multiplexed streams are time-divisionally mufti - 

5 plexed to generate a degree two multiplexed stream, said degree-one multiplexed streams being a time-divisionally 

multiplexed bitstream of one or more digital signals having a time reference value attached thereto, comprising: 

reception means for receiving a plurality of degree-one multiplexed streams from said degree-one multiplexers; 
multiplexing means for time-divisionally multiplexing the received degree-one multiplexed streams based on a 
10 repetitive pattern associated with a bitrate of the degree-one multiplexed streams to generate the degree two 

multiplexed stream; and 

time reference value correction means for operating based on asynchronous reference clocks not synchro- 
nized with reference clocks for operating the degree-one multiplexers and for correcting the time reference 
value appended to said degree two multiplexed stream; 
75 said multiplexing means multiplexing a pre-set quantity of dummy data if the time reference value corrected by 

said time reference value correction means becomes larger than the time reference value attached to the 
degree-one multiplexed streams by the degree-one multiplexers by a value larger than a pre-set value. 

2. The digital signal multiplexing apparatus according to claim 1 wherein said reception means receives from the 
20 respective degree-one multiplexers the degree-one multiplexed streams of a bitrate lower than a bitrate assigned 

on the basis of a repetitive pattern for multiplexing by said multiplexing mean (assigned bitrate). 

3. The digital signal multiplexing apparatus according to claim 2 wherein said reception means receives from the 
respective degree-one multiplexers the degree-one multiplexed streams of a bitrate represented by 

25 

(CrMIN/CpMAX) x P 

where CrMIN is the minumum value of the rating of the reference clocks for operating said time reference value cor- 
rection means, CpMAX is the minimum value of the rating of the reference clocks for operating said degree-one 
30 multiplexers and P is the assigned bitrate. 

4. The digital signal multiplexing apparatus according to claim 1 wherein said multiplexing means time-divisionally 
multiplexes the respective received degree-one multiplexed streams after lapse of delay exceeding the maximum 
delay time of the degree-one multiplexed streams generated by said reception memories. 

35 

5. The digital signal multiplexing apparatus according to claim 1 wherein said reception memories receive a transport 
stream prescribed by ISO-13818-1 and wherein said multiplexing means generates a transport stream provided in 
IS013818-1. 

40 6. The digital signal multiplexing apparatus according to claim 5 wherein said time reference value correction means 
corrects a program clock reference (PCR) value attached to a transport stream prescribed by ISO-13818-1 . 

7. The digital signal multiplexing apparatus according to claim 5 wherein said multiplexing means multiplexes a null 
packet prescribed in I S0 1381 8-1. 

45 

8. A method for multiplexing digital signals comprising: 

receiving degree-one multiplexed streams from a plurality of degree-one multiplexers, said degree-one multi- 
plexed streams being a time-divisionally multiplexed bitstream of one or more digital signals having a time ref- 
so erence value attached thereto; 

time-divisionally multiplexing received degree-one multiplexed streams based on a repetitive pattern associ- 
ated with the bitrate of respective degree-one multiplexed streams to generate a degree two multiplexed 
stream; 

55 

correcting the time reference value attached to the time reference value attached to the degree two multiplexed 
stream based on asynchronous reference clocks not synchronized with reference clocks for operating said 
degree-one multiplexers; and 



11 



BNSDOCID: <EP 0932308A2_L> 



EP 0 932 308 A2 



multiplexing a pre-set volume of dummy data if the corrected time reference value exceeds the time reference 
value attached to the degree-one multiplexed streams by more than a predetermined value. 

9. The method for multiplexing digital signals according to claim 8 wherein the degree-one multiplexed streams of a 
bitrate lower than the bitrate assigned based on the repetitive pattern for multiplexing (assigned bitrate). 

1 0. The digital signal multiplexing method according to claim 9 wherein the degree-one multiplexed streams of a bitrate 
represented by 

(CrMIN/CpMAX) x p 

are received from the respective degree-one multiplexers, where CrMIN is the minimum value of the rating of the 
reference clocks for operating said time reference value correction means. CpMAX is the minimum value of the rat- 
ing of the reference clocks for operating said degree-one multiplexers and P is the assigned bitrate. 

1 1 . The digital signal multiplexing method according to claim 8 wherein the respective received degree-one multiplexed 
streams are time-divisionally multiplexed after lapse of delay exceeding the maximum delay time of the degree-one 
multiplexed streams generated by reception. 

12. The digital signal multiplexing method according to claim 8 wherein a transport stream prescribed by ISO-13818-1 
is received and wherein a transport stream provided in IS013818-1 is generated. 

13. The digital signal multiplexing method according to claim 12 wherein a program clock reference (PCR) value 
attached to a transport stream prescribed by ISO-13818-1 is corrected. 

14. The digital signal multiplexing method according to claim 12 wherein said multiplexing means multiplexes a null 
packet prescribed in IS013818-1 as dummy data. 

1 5. An apparatus for transmitting digital signals comprising: 

a plurality of degree-one multiplexers for time-divisionally multiplexing a bitstream of one or more digital signals 
and for attaching a time reference value to generate a plurality of degree-one multiplexed streams; and 
a degree-two multiplexing device including reception means for receiving plural degree-one multiplexed 
streams from said degree-one multiplexers, multiplexing means for time-divisionally multiplexing the received 
degree-one multiplexed streams based on a repetitive pattern associated with the bitrate of respective degree- 
one multiplexed streams to generate a degree two multiplexed stream, time reference value correcting means 
for correcting the time reference value attached to the degree two multiplexed stream based on asynchronous 
reference clocks not synchronized with reference clocks adapted for operating said degree-one multiplexers 
and transmission means for transmitting the degree two multiplexed stream generated by said multiplexing 
means, said degree-two multiplexing device multiplexing a pre-set volume of the dummy data when the time 
reference value corrected by said time reference value correction means becomes larger than the time refer- 
ence value attached to the degree-one multiplexed streams by the degree-one multiplexers by a value larger 
than a pre-set value. 

16. The digital signal transmitting apparatus according to claim 15 wherein each degree-one multiplexer generates a 
degree-one multiplexed stream at a bitrate lower than the bitrate assigned based on the repetitive pattern for mul- 
tiplexing (assigned bitrate). 

17. The digital signal transmitting apparatus according to claim 15 wherein the degree-one multiplexed streams of a 
bitrate represented by 

(CrMIN/CpMAX) x P 

are generated by the degree-one multiplexers, where CrMIN is the minimum value of the rating of the reference 
clocks for operating said time reference value correction means. CpMAX is the minimum value of the rating of the 
reference clocks for operating said degree-one multiplexers and P is the assigned bitrate. 

18. The digital signal transmitting apparatus according to claim 15 wherein the respective received degree-one multi- 
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plexed streams are time<Jivisionaily multiplexed by the multiplexing means of said degree-two multiplexer after 
lapse of delay exceeding the maximum delay time of the degree-one multiplexed streams generated by reception. 

19. A digital signal transmitting method comprising: 

5 

time-divisionally multiplexing a bitstream of one or more digital signals by pre-set reference clocks and attach- 
ing a time reference value for generating a plurality of degree-one multiplexed streams; 
receiving said degree-one multiplexed streams; 

time-divisionally multiplexing the received degree-one multiplexed streams, based on a repetitive pattern asso- 
10 ciated with the bitrate of each degree-one multiplexed stream, to generate a degree two multiplexed stream; 

correcting the time reference value attached to the degree two multiplexed stream based on reference clocks 
not synchronized with the reference clocks adapted for generating each degree-one multiplexed stream for 
transmitting the degree two multiplexed stream; and 

transmitting the degree two multiplexed stream, on which are multiplexed a pre-set volume of the dummy data, 
is if the corrected time reference value has become than the time reference value attached to the degree-one 

multiplexed streams by the degree-one multiplexers by a value larger than a pre-set value. 

20. The digital signal transmitting method according to claim 19 wherein said degree-one multiplexed streams of a 
bitrate lower than a bitrate assigned on the basis of a repetitive pattern for multiplexing (assigned bitrate) are gen- 

20 erated. 

21. The digital signal transmitting method according to claim 20 wherein said degree-one multiplexed streams of a 
bitrate represented by 

25 (CrMIN/CpMAX) x P 

are generated, where CrMIN is the minimum value of the rating of the reference clocks for operating said time ref- 
erence value correction means. CpMAX is the minimum value of the rating of the reference clocks for operating said 
degree-one multiplexers and P is the assigned bitrate. 

30 

22. The digital signal transmitting method according to claim 1 9 wherein said degree-one multiplexed streams are time- 
divisionally multiplexed after lapse of delay exceeding the maximum delay time generated by transmission of the 
degree-one multiplexed streams. 

35 23. An apparatus for recording digital signals comprising: 

a plurality of degree-one multiplexers for time-divisionally multiplex a bitstream of one or more digital signals 
and for attaching a time reference value to generate a plurality of degree-one multiplexed streams; and 
a degree-two multiplexing device including reception means for receiving degree-one multiplexed streams from 
*o said degree-one multiplexers, multiplexing means for time-divisionally multiplexing the received degree-one 

multiplexed streams based on a repetitive pattern associated with the bitrate of respective degree-one multi- 
plexed streams to generate a degree two multiplexed stream, time reference value 

value correction means for correcting the time reference value attached to the degree two multiplexed stream 
based on asynchronous reference clocks not synchronized with reference docks adapted for operating said 
45 degree-one multiplexers and recording means for recording the degree two multiplexed stream generated by 

said multiplexing means on a recording medium, said degree-two multiplexing device multiplexing a pre-set 
volume of the dummy data when the time reference value corrected by said time reference value correction 
means becomes larger than the time reference value attached to the degree-one multiplexed streams by the 
degree-one multiplexers by a value larger than a pre-set value. 

so 

24. The digital signal recording apparatus according to claim 23 wherein said degree-one multiplexers generate the 
degree-one multiplexed streams of a bitrate lower than a bitrate assigned on the basis of a repetitive pattern for 
multiplexing by said multiplexing mean (assigned bitrate). 

55 25. The digital signal recording apparatus according to claim 24 wherein said degree-one multiplexers generate the 
degree-one multiplexed streams of a bitrate represented by 

(CrMIN/CpMAX) x P 
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where CrMIN is the minimum value of the rating of the reference clocks for operating said time reference value cor- 
rection means, CpMAX is the minimum value of the rating of the reference clocks for operating said degree-one 
multiplexers and P is the assigned bitrate. 

5 26. The digital signal recording apparatus according to claim 23 wherein said multiplexing means of said degree-two 
multiplexer time-divisionally multiplexes the respective received degree-one multiplexed streams after lapse of 
delay exceeding the maximum delay time of the degree-one multiplexed streams generated by transmission by said 
degree-one multiplexers. 

10 27. A digital signal recording method comprising: 

time-divisionally multiplexing a bitstream of one or more digital signals by pre-set reference clocks and attach- 
ing a time reference value for generating a plurality of degree-one multiplexed streams; 

15 receiving said degree-one multiplexed streams; 

time-divisionally multiplexing the received degree-one multiplexed streams, based on a repetitive pattern asso- 
ciated with the bitrate of each degree-one multiplexed stream, to generate a degree two multiplexed stream; 

20 correcting the time reference value attached to the degree two multiplexed stream based on reference clocks 

not synchronized with the reference clocks adapted for generating each degree-one multiplexed stream for 
recording the degree two multiplexed stream; and 

recording the degree two multiplexed stream, on which are multiplexed a pre-set volume of the dummy data, if 
25 the corrected time reference value has become than the time reference value attached to the degree-one mul- 

tiplexed streams by the degree-one multiplexers by a value larger than a pre-set value. 

28. The digital signal recording method according to claim 27 wherein said degree-one multiplexed streams of a bitrate 
lower than a bitrate assigned on the basis of a repetitive pattern for multiplexing (assigned bitrate) are generated. 

30 

29. The digital signal recording method according to claim 28 wherein said degree-one multiplexed streams of a bitrate 
represented by 

(CrMIN/CpMAX) x P 

35 

are generated, where CrMIN is the minimum value of the rating of the reference clocks for operating said time ref- 
erence value correction means, CpMAX is the minimum value of the rating of the reference clocks tor operating said 
degree-one multiplexers and P is the assigned bitrate. 

40 30. The digital signal recording method according to claim 27 wherein said degree-one multiplexed streams are time- 
divisionally multiplexed after lapse of delay exceeding the maximum delay time generated by transmission of the 
degree-one multiplexed streams. 

31 . A recording medium having a degree two multiplexed stream recorded thereon, said degree two multiplexed stream 
45 being recorded on the recording medium by: 

time-divisionally multiplexing a bitstream of one or more digital signals by pre-set reference clocks and attach- 
ing a time reference value for generating a plurality of degree-one multiplexed streams; 
time-divisionally multiplexing the received degree-one multiplexed streams, based on a repetitive pattern asso- 

50 ciated with the bitrate of each degree-one multiplexed stream, to generate a degree two multiplexed stream; 

correcting the time reference value attached to the degree two multiplexed stream based on reference clocks 
not synchronized with the reference docks adapted for generating each degree-one multiplexed stream; and 
recording the degree two multiplexed stream on the recording medium; on the condition that the degree two 
multiplexed stream is recorded in a state in which a pre-set volume of the dummy data are multiplexed thereon 

55 if the corrected time reference value has become than the time reference value attached to the degree-one 

multiplexed streams by a value larger than a pre-set value. 
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